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DETAILED ACTION 

1 . In view of the Appeal Brief filed on 08 September 2008, PROSECUTION IS 
HEREBY REOPENED. A new ground of rejection is set forth below. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1 .1 1 1 ; or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41.20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621. 

2. In the previous Office action, claims 1, 4-7, 10-14, 17-19, and 21-24 were 
rejected under 35 U.S.C. 103(a) as obvious over US Patent 5,285,667 A (Zimmermann) 
in view of JP W1 0-1 34,1 87 A (House). Claims 3 and 16 were rejected under 35 U.S.C. 

103(a) as obvious over Zimmermann in view of House, and in view of US 5,414,521 
(Ansley). 
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3. A new translation of JP fill 0-1 34187 is available and is placed in the record. US 
6,847,392 B1, previously used as the translation, is to be disregarded. 

Response to Arguments 

4. Appellant argues that the cited references do not recite the claimed limitations in 
each of independent claims 1,14, and 21 of "transforming wide angle image data"... "on 
a pixel-by-pixel basis" (Appeal Brief, pg. 4). Appellant is correct in stating that the 
Zimmerman reference was not relied on for this limitation (Final Rejection, pg. 5; Appeal 
Brief, pg. 5), but is incorrect in stating that the House reference does not disclose this 
limitation. Appellant states that the House reference "contracts the narrow visual field to 
make it coincide with that of a pixel unit of the wide visual field image", but states that 
this is not a "transformation" of the wide visual field image. While this may be true for 
the first and second embodiments of in House, in a third embodiment, shown in figure 4 
and described in paragraphs 0075-0080, rather than sampling a narrow-field image, 
instead the "wide vision field picture" is interpolated on a pixel basis in picture 
interpolation section 401 (paragraph 0077). This is a transformation of "wide angle 
image data" as presented in claims 1,14, and 21 . Since this embodiment was not cited 
in the previous final rejection, its inclusion is a new ground of rejection. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 1, 4-7, 10-14, 17-19, and 21-24 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over US Patent 5,185,667 A (Zimmermann) in view of Japanese 
Laid-Open Patent Application W1 0-1 34,1 87 A (House). 

Zimmermann teaches an omnidirectional (wide-angle) imaging system. 
Regarding claim 1, figure 1 illustrates the system of Zimmermann. Image buffer 4 
receives images (column 3: line 31) having a 180-degree field of view (column 3: line 
28), corresponding with the claimed "first input buffer". Image processing system 
consisting of X-Map 6 and Y-Map 7, coupled to image buffer 4, perform a transform of 
the image data (column 3: lines 32-35), corresponding with the claimed "image data 
processor", and display driver 10 scans the transformed images for display (column 3: 
line 47), corresponding with the claimed "encoder". This transformation is performed on 
the basis of transforming "object points" having (u,v) coordinates to "image points" 
having (x,y) coordinates (column 5: lines 39-46; column 7: lines 53-62. However, the 
present invention describes outputting corrected image data "upon completion of each 
pixel transformation", while Zimmermann may or may not re-buffer transformed image 
data into image buffer 4. 

House teaches a three-dimensional imaging apparatus. Regarding claim 1, as 
shown in figure 1 of House, a wide visual field picture 5 and narrow visual field picture 6, 
from two separate cameras 3 and 4 (paragraphs 0037-0038), are inputted to depth 
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picture formation section 9. Mapping of each pixel is performed to determine the depth 
of the pixels, and each pixel depth is output "to the outside" as data in a depth picture 
11 (paragraph 0064) without additional buffering. In one embodiment, shown in figure 
3, the pixels from the narrow field vision field picture 6 are pruned to match the narrow 
picture to the wide picture (paragraphs 0068-0069). However, in another embodiment, 
shown in figure 4, the pixels of the wide vision field picture 5 are interpolated to match to 
the size of the narrow vision field picture 6 (paragraphs 0076-0077). This corresponds 
with the claimed pixelwise transform of "wide angel image data". This expansion of 
wide-picture pixel data to create a three-dimensional "depth picture" (paragraph 0078) 
and construct the three-dimensional structure of the vision field of the cameras 
(paragraph 0079). 

Zimmermann discloses the invention except for performing a pixelwise 
transformation and directly outputting the results on a pixel-by-pixel basis. House 
teaches that it was known to immediately output pixel mapping data upon processing a 
wide angle picture. Therefore, it would have been obvious to one having ordinary skill 
in the art at the time the invention was made to directly output image mapping data 
pixelwise without an output buffer, as taught by House, since it has been held that the 
omission of an element and its function in a combination where the remaining elements 
perform the same functions as before involves only routine skill in the art. See In re 
Karlson, 136 USPQ 184. 
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Regarding claims 4 and 5, the image processing system of Zimmermann is 
coupled to microcomputer control interface 5, which communicates user-determined 
transformation coefficients based on input from an input means such as joystick 12 
(column 3: lines 35-43). Regarding claim 6, "X-MAP and Y-MAP transform processors 
6 and 7... can be accomplished with application specific integrated circuits or other 
means as will be known to persons skilled in the art" (column 4: lines 1-5). 

Regarding claims 7 and 10, camera 2 is a source of wide-angle image data 
(column 3: line 29). Regarding claim 11, Zimmermann outputs data in NTSC format 
(column 2: lines 25-29). The examiner takes Official Notice that it was well within the 
level of ordinary skill in the art at the time the invention was made to output video in PAL 
or SECAM format if NTSC output was possible. Regarding claim 12, video is output to 
display device 11 (column 3: line 47). Regarding claim 13, the output of the 
transformation circuits is a corrected image, as shown in figure 3 (column 4: lines 36- 
38). 

Regarding claim 14, in Zimmermann, image buffer 4 buffers wide-angle image 
data, transformation circuits 6 and 7 transform the buffered wide-angle image data into 
corrected image data, display driver 10 encodes the corrected image data, and display 
device 11 displays output signals. Regarding claim 15, transformation circuits 6 and 7 
perform a transform of distorted hemispherical data to rectilinear data according to 
known mathematical transformations determined by the parameters of the wide-angle 
lens 1 in camera 2. Regarding claims 17 and 18, input means 12 provide user image 
command data to image processors 6 and 7 through microcomputer 5 to transform the 
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buffered wide-angle image into corrected image data, based on calculated parameters 
determined from user command data. Regarding claim 19, transformation circuits 6 and 
7 transform buffered wide-angle image data into corrected image data representative of 
a substantially undistorted image. 

Regarding claim 21, this claim is in means-plus-function format, complying with 
35 U.S.C. 112, sixth paragraph. Then, the subject matter of claim 21 is limited to that 
as described in the specification. In Zimmermann, input image buffer 4 corresponds 
with the "means for storing", X-map 6 and Y-map 7 correspond with the "means for 
transforming", and display driver 10 corresponds with the "means for encoding". 

Regarding claims 22-24, Zimmermann et al. teaches a variable zoom function 
"that allows a change in the field of view of the output image" (column 4: lines 61-63). 

7. Claims 3 and 16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Zimmermann in view of House as applied to claims 1 and 14 above, and further in view 
of US Patent 5,414,521 (Ansley). Claims 3 and 16 are directed to performing a 
transformation calculation based on a look-up table. Zimmerman does not disclose this 
feature. 

Ansley teaches an image distortion correction system for a flight simulator. In 
Ansley, an image is displayed on a curved dome screen. As the pilot's viewing angle 
changes, distortion becomes apparent and must be mitigated (column 6: lines 3-8). 
Regarding claims 3 and 16, a computer determines the field of view and viewing angle 
of the pilot for every possible type of motion for the simulator (column 6: lines 23-35), 
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and determines a set of correction coefficients to eliminate distortion during this motion. 
These coefficients are stored in a look-up table memory (column 6: lines 35-39). When 
a certain viewing angle and field of view is received, the look-up memory provides the 
appropriate coefficients to correct the distortion (column 6: lines 39-66). 

Zimmermann, in combination with House, discloses the claimed invention except 
for calculating a distortion correction based on a look-up table. Ansley teaches that it 
was known to store pre-calculated image distortion correction coefficients in a look-up 
table memory. Therefore, it would have been obvious to one having ordinary skill in the 
art at the time the invention was made to perform an image correction calculation based 
on data in a look-up table, as taught by Ansley, since Ansley states in column 6, lines 
66-68 that such a modification would greatly increase the speed of a distortion 
correction process, since the pre-computed values do not have to be re-determined for 
each new frame. 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to David N. Werner whose telephone number is (571)272- 
9662. The examiner can normally be reached on Monday-Friday from 10:00-6:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



ID. N. W./ 

Examiner, Art Unit 2621 
/Mehrdad Dastouri/ 

Supervisory Patent Examiner, Art Unit 2621 



